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VOLUME  II 


COST  BATA  ANALYSIS  METHODOLOGY 
FOR 

THE  DEFENSE  NUCLEAR  AGE.-'CY  LIFE  CYCLE  COST  EXPERIMENT 
-  AN  INTERIM  REPORT  - 


I.  INTRODUCTION 


The  Defense  Nuclear  Agency  Life  Cycle  Cost  Experiment  (LCCE) 
will  generate  valuable  cost  and  technical  data  related  to  the 
protection  of  certain  types  of  command  and  control  communications 
facilities  against  electro-magnetic  pulse  (EMP) .  Two  EMP  protec¬ 
tion  design  concepts  are  being  evaluated:  custom  shielding  and 
tailored  protection.  Custom  shielding  will  be  retrofitted  by 
Rockwell  International  to  a  commercial  technical  control  and  a 
microwave  transceiver  at  Hickam  Air  Force  Base  and  a  commercial 
technical  control  and  an  overseas  cablehead  at  Makaha.  Hawaii. 
Tailored  protection  will  be  retrofitted  by  Boeing  Aircraft  to  a 
technical  control  at  Camp  Smith.  Except  for  Camp  Smith,  all  of 
these  facilities  will  be  tested  to  determine  if  they  meet  EMP 
protection  design  specifications. 

A  computerized  Life  Cycle  Cost  (LCC)  model  is  being  developed 
in  cooperation  with  Booz-Allen  and  Hamilton,  Inc.  Details'  are 
included  in  their  report.  In  general,  LCCE  cost  data  will  be 
collected  under  the  following  categories:  requirements  defini¬ 
tion,  design,  fabrication,  installation  and  checkout,  test  and 
evaluation,  operations  and  maintenance,  and  program/systems 
management.  Each  category  includes  a  number  of  sub-categories. 
For  example,  the  requirements  definition  category  includes  sub¬ 
categories  for:  facility  protection  requirements,  facility  sur¬ 
vey  costs,  requirements  analysis,  and  surveillance  and  mainte¬ 
nance  requirements.  Each  sub-category  includes  elements  which 
indicate  specific  labor,  materials,  equipment,  travel,  and  over¬ 
head  charges.  For  example,  the  facility  protection  requirements 

sub — category  includes  elements  for  scientific  and  consultant 
manhours,  design  engineering  manhours,  pre-installation  test  and 
evaluation  manhours,  design  quality  control  manhours,  test  and 
evaluation  equipment  costs,  travel,  and  design  overhead  costs. 

As  of  this  date,  sub-categories  and  elements  have  been  esta¬ 
blished  for  requirements  definition,  design,  fabrication,  and 
installation  and  checkout.  Sub-categories  and  elements  remain  to 
be  developed  for  the  test  and  evaluation  and  operations  and 
maintenance  categories.  This  \/ill  be  done  after  a  meeting  with 
representatives  from  the  Hawaiian  Telephone  Company,  the  1957th 
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Cam unlcaticns  Croup,  IRT  on  17  May  1984.  I  foresee  no  major 
problems . 

The  LCC  cost  model  contains  three  special  features.  First, 
it  separates  LCCE-unique  costs  from  costs  that  will  be  incurred 
in  future  EMP  protection  retrofit  programs.  This  separation  will 
permit  future  users  of  the  data  base  to  extract  only  those  cost 
elements  which  pertain  to  their  respective  programs.  Second, 
this  LCCE  model  permits  detailed  adjustments  for  inflation.  Ele¬ 
ments  are  refined  to  the  point  that  inflation  indices  can  be  used 
for  particular  labor  and  material  costs.  Third,  learning  curve 
analysis  can  be  applied  to  labor-intensive  activities.  If  EMP 
protection  retrofit  programs  are  implemented  on  a  large  scale, 
learning  curve  analysis  would  be  appropriate  to  enhance  the  accu¬ 
racy  of  forecasts  for  certain  labor  cost  elements. 

At  this  point,  it  is  pertinent  to  consider  how  the  cost  data 
base  might  be  used.  LCCE  requirements  definition,  design,  fabri¬ 
cation,  and  installation  and  checkout  are  essentially  research 
and  development  (R&D)  activities.  I ' would  add  a  new  category, 
programs/systems  management,  to  this  list.  As  shown  by  W.J. 
Weida  an  S-curve,  with  cumulative  R&D  dollars  spent  as  the  depen¬ 
dent  variable  and  time  as  the  independent  variable,  provides  a 
highly  accurate  model  for  forecasting  R&D  expenditures  per . time 
period.  The  problem  remains  of  what  to  do  with  the  test  and 
evaluation  and  the  operations  and  maintenance  cost  data.  1 
believe  that  we  may  be  able  to  use  all  LCCE  cost  categories .  in  a 
benefit-cost  model. 

This  paper  provides  details  on  the  S-curve  R&D  cost  forecast¬ 
ing  model  and  the  benefit-cost  model  for  comparing  alternative 
EMP  protection  designs.  The  S-curve  model  can  be  developed  from 
the  LCCE  data  base  with  no  limiting  requirements.  The  benefit- 
cost  model  has  one  critical  requirement:  it  must  include  some 
measure  of  the  relative  benefits  of  the  alternative  designs. 
Without  such  a  measure,  legitimate  life  cycle  cost  comparisons 
cannot  be  made.  It  is  my  understanding  that  a  generic  test  pro¬ 
cedure  to  measure  the  degree  of  protection  achieved  is  in  the 
process  of  being  developed.  If  this  development  succeeds,  we 
will  have  a  measure  of  relative  benefits,  and  we  can  use  a 
benefit-cost  model  to  compare  the  alternative  EMP  protection 
designs . 

In  the  following  sections,  I  present  detailed  descriptions 
for  the  S-curve  model  and  the  benefit-cost  model.  Both  models 
are  adapted  for  use  with  the  LCCE  cost  data  base,  and  are  suit¬ 
able  for  planning  the  expenditures  for  future  EMP  protection 
retrofit  programs.  The  final  section  contains  a  brief  summary 
and  provides  certain  policy  recommendations  for  DNA/RAEE. 


II.  S-CURVE  R&D  COST  FORECASTING  MODEL 


Background 


As  indicated  earlier,  an  S-eurve  was  shown  by  W.J.  Weida  to 
be  a  highly  accurate  form  for  forecasting  R&D  dollars  spent  per 
time  period.  If  we  realize  that  an  S-curve  is  merely  the  cumula¬ 
tive  form  of  a  bell-curve  (which  may  or  may  not  be  skewed)  as 
shown  in  the  following  figure,  a  methodology  for  forecasting  R&D 
costs  per  time  period  becomes  apparent. 


Figure  1:  Derivation  of  the  S-Curve 


The  S-curve  can  be  fitted  to  historic  cost  data  on  similar 
R&D  projects.  Essentially,  two  curves  are  fitted  to  the  data, 
one  curve  from  time  zero  to  the  inflection  point,  and  the  other 
curve  from  the  inflection  point  to  the  d  ata  pC  int  obtained  at  the 
end  of  the  R&D  effort.  Both  fitted  curves  follow  a  quadratic' 
form: 
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y  ■  a  +  b^x  +  b2*  1 

where  a,  b.,  and  h2  are  coefficients  estimated  from  a  least  squares 
regression.  Y  and  x  are  the  dependent  and  independent  variables, 
respectively.  Before  fitting  the  two  curves,  the  data  are  nor¬ 
malized  to  percent  cumulative  dollars  expended  (y)  and  percent 
time  expended  (x)  .  Normalization  permits  the  use  of  the  S-curve 
to  forecast  R&D  costs  for  programs  that  differ  in  total  dollars 
spent  and  time  expended.  The  inflection  point  can  easily  be  cal¬ 
culated  by  looking  at  the  second  differences  of  cost  with  respect 
to  time,  and  the  two  curves  can  be  joined  at  this  point.  r 


Standard  confidence  interval  techniques  can  be  used  to  assess  the 
variation  of  actual  RfcD  costs  from  forecasted  costs.  The  fore¬ 
cast  can  be  updated  as  data  become  available  after  a  new  RtD 
effort  is  started. 

Developing  and  Using  the  S-Curve 

The  general  method  for  developing  an  S-curve  from  LCCE  cost 
data  can  be  described  in  a  five-step  procedure.  These  five  steps 
are  described  as  follows: 

Step  1.  LCCE  R&D  expenditures  per  time  period  should  be 
gathered  and  recorded  as  a  cumulative  percentage  of  total  R&D 
expenditure.  LCCE  R&D  expenditures  include  all  generic  cost  data 
gathered  in  the  requirements  definition#  design,  fabrication# 
installation  and  checkout,  and  programs/systems  management 
categories.  Similarly,  the  amount  of  time  over  which  the  R&D 
effort  is  to  run  should  be  determined  and  each  succeeding  time 
increment  should  be  recorded  as  a  cumulative  percent  of  the  total 
program  time.  This  step  has  the  effect  of  normalizing  the  data 
so  that  it  can  be  used  to  forecast  for  future  EMP  protection 
retrofit  programs.  See  Figure  2. 
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Figure  2:  Expenditures  vs.  Time 
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Step  2.  With  the  data  arrayed  in  a  normalized  format  and 
plotted  on  the  axes  of  Figure  2,  the  budget  expenditure  pattern 
may  be  immediately  checked  for  general  conformity.  This  is 
accomplished  by  determining  whether  or  not  the  cumulative  expen¬ 
diture  curve  follows  the  S-curve  pattern  established  by  Weida  for 
all  previous  Department  of  Defense  R&D  projects,  i.e.,  if  the 
LCCE  cumulative  budget  expenditures  follow  the  pattern  shown  in 
Figure  3,  then  these  expenditures  are  in  accordance  with  past  R&D 
experience . 
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Figure  3:  The  General  R&D  S-Curve 

According  to  Weida,  the  general  curve  can  be  described  by  the 
following  equations: 

T  *  -0.0124  +  0.5376X  +  1.396X2  (Bottom  Half} 

V  «  -0.5345  +  3.1150X  -  1.584X2  (Top  Half) 


The  one-standard  deviation  (la)  confidence  interval  about  the 
inflection  point  was  described  by  Weida  as  follows: 

Mean:  0.562  (vertical  axis),  0.452  (horizontal  axis) 

cr=o.  05402  (vertical  ax  is) 

y 

a ■  =  0.07300  (horizontal  axis) 

If  the  expenditure  pattern  does  not  follow  the  general  S- 
curve  pattern,  then  alternative  model  specifications  should  be 
tried.  For  example,  one  might  use  a  logarithmic  form  as  a  means 
to  describe  the  cumulative  expenditure  pattern. 

Step  3.  Next,  locate  the  largest  incremental  change  in  cumu¬ 
lative  expenditures  which  is  followed  by  two  periods  of  decreas¬ 
ing  cumulative  expenditures.  This  increment  is  designated  as  the 
inflection  point.  The  S-shaped  curve  is  broken  at  this  point  and 
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the  inflection  point  btvos^s  tbw  dsts  point  in  the  first  (or 
lower)  curve  and  the  first  data  point  on  the  second  (upper) 
curve.  This  common  point  allows  the  curves  to  be  spliced  again 
after  curve  fitting.  The  moan  inflection  point  and  lo-  values’tor 
the  general  S-curve  were  described  earlier;  however*  past  experi¬ 
ence  has  shown  a  high  degree  of  variability  in  the  inflection 
point  locations  compared  to  the  general  S-curve. 

Step  4.  Equations  for  the  lower  and  upper  portions  of  the 
LCCE  S-curve  are  developed  using  standard  regression  techniques. 
Particular  care  must  be  taken  in  this  step  to  assure  that  the 
curve  equations  which  arc  developed  have  dealt  with  the  problems 
inherent  in  the  use  of  time  series  data.  Failure  to  correct  the 
problem  of  autocorrelation  will  result  in  curve  equations  which 
are  of  little  value  and  which  will  adversely  affect  the  perfor¬ 
mance  of  the  completed  model.  To  correct  this  problem,  the 
Cochran-Orcutt  procedure  for  alleviating  serial  autocorrelation 
is  usually  applied. 

Step  5.  Once  the  curve  equations  have  been  developed  from 
the  budget  data,  two  specific  types  of  knowledge  have  been 
gained.  First,  the  equation  form  which  best  fits  the  R&D  budget 
data  has  now  been  determined.  This  is  usually  a  quadratic  form 
for  both  the  upper  and  lower  halves  c£  the  S-shaped  curve.  •  This 
specific  curve  form  should  be  used  with  any  actual  expenditures 
when  later  attempts  are  made  to  forecast  the  R& D  costs  of  future 
EMP  protection  programs.  Second,  equations  expressing  the  sub¬ 
jective  planning  inherent  in  the  R&D  program  ace  now  available 
for  the  upper  and  lower  parts  of  the  S-shaped  curve.  These  equa¬ 
tions  can  be  used  as  constraints  during  forecasting,  thus  provid¬ 
ing  a  method  of  incorporating  this  subjective  information  into 
the  final  cost  forecast.  The  specific  methods  by  which  the  S- 
curve  may  be  used  for  cost  forecasting  are  the  subjects  of  the 
next  section. 

The  S-Curve  as  a  Forecasting  Tool 

The  methodology  developed  in  the  previous  section  will  result 
in  an  S-curve  for  forecasting  R&D  costs  for  future  EMP  protection 
programs.  The  S-curve  will  be  based  upon  LCCE  cost  data.  It  is 
appropriate  at  this  point  to  convey  the  proper  method  for  employ¬ 
ing  the  S-curve  as  a  management  tool.  The  program  manager  should 
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The  methodology  followed  in  this  section  is  an  abbreviated 
version  of  Weida's  presentation  in  A  General  technique  of  R&D 
Forecasting ,  U.S.  Air  Force  Academy  Technical  Report  77-12,  Sep¬ 
tember,  1977. 


view  the  forccas-  as  a  nor.-throatening  means  of  alerting  managers 
to  possible  program  difficulties  and  it  should  be  presented  not 
as  a  point  estimate,  but  rather  as  a  range  of  values  within  which 
the  end  cost  of  the  program  is  likely  to  fall  if  the  present 
courses  of  action  are  continued.  For  the  purpose  of  this  paper, 
three  points  along  this  possible  range  of  cost  will  be  identified 
as:  (1)  the  best  possible  R&D  cost,  (2)  the  most  likely  R&D 
cost,  and  (3)  the  worst  possible  R&D  cost.  The  best  possible  R&D 
cost  occurs  if  the  second  half  of  the  program  will  follow  exactly 
the  LCCE  R&D  curve  irrespective  of  the  performance  record  esta¬ 
blished  in  the  first  half  of  the  program.  The  most  likely  pro¬ 
gram  cost  if.  obtained  if  the  second  half  of  the  program  fellows 
the  course  indicated  by  the  LCCE  R&D  curve  as  updated  by  data 
made  available  from  the  first  half  of  the  EMP  protection  retrofit 
program  being  forecasted.  The  worst  possible  program  cost  would 
be  indicated  by  the  upper  limit  of  the  confidence  interval  around 
the  updated  forecast. 

These  three-  types  of  forecasts  are  shown  in  Figure  4.  The 
details  involved  in  forming  each  of  these  forecasts  will  now  be 
discussed. 
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Figure  4:  Three  Possible  Forecasts 


The  Best  Possible  Cost 

First,  derive  the  two  halves  of  the  equation  for  the  S-shaped 
curve  in  the  manner  previously  outlined.  This  gives  curve  1  of 
Figure  5,  the  LCCE  R&D  curve,  or  for  the  purpose  of  this  discus¬ 
sion,  the  budget  curve. 

Assume  now  that  the  first  data  points  concerning  actual 
expenditure  information  have  become  available.  These  data  points 
are  first  deflated  by  dividing  the  dollar  figures  by  an  appropri¬ 
ate  inflation  index.  Studies  have  shown  that  the  GNP  Deflator  is 
usually  a  good  choice  for  this  index.  The  deflated  figures  are 
then  converted  to  percentage  figures  by  dividing  by  the  latest 
deflated  total  program  cost,  and  these  percentage'  figures  are 
plotted  on  the  axis  of  Figure  2.  This  leads  to  the  beginning  of 
an  "actuals"  curve.  These  actuals  may  be  used  to  forecast  a  new 
end  cost  for  the  program  as  follows: 

(1)  Derive  a  new  lower  half  of  the  S-shaped  curve  by 
fitting  the  actuals  to  an  equation  of  the  form  found  to  be 
appropriate  for  the  budget  data — in  general,  this  will  be  a  qua¬ 
dratic  curve. 

(2)  Using  this  quadratic  curve  equation,  insert  the  per¬ 
cent  of  total  time  figure  for  the  budget  curve  inflection  point 
(35%  on  Figure  5)  to  forecast  a  new  inflection  point,  and  -then 
use  other  points  on  the  X  (time)  axis  to  derive  a  new  lower  half 
for  the  S-shaped  curve. 

(3)  Now  take  the  equation  which  was  developed  for  the 
top  half  of  the  budget  curve  and  substitute  the  percent  time  and 
percent  budget  figures  for  the  forecast  inflection  point  into 
this  equation  to  calculate  a  new  intercept  for  the  upper  curve. 
This  new  intercept,  along  with  the  original  slope  figures  from, 
the  budget  curve,  has  the  effect  of  "splicing"  tne  equation 
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Brush,  John  S.,  "Study  of  Possible  Improvements  in  the  Ac¬ 
curacy  of  Aeronautical  Economic  Escalation  Indices,"  unpublished 
paper,  USAF  Academy,  Colorado,  February  1976.  Alternatively,  in¬ 
dices  for  specific  labor  and  materials  can  be  found  in:  The  Sta¬ 
tistical  Abstract  of  the  Uni  ted  States ,  published  annually  by  the 
U.S.  Department  of  Commerce.  Sections  12,  14,  and  16  are  of  par¬ 
ticular  interest  in  the  1984  edition.  Another  source  of  special¬ 
ized  indices  would  be:  Basic  Economic  Statistics ,  published 
monthly  by  the  Bureau  of  Economic  Stat-'. r*-4 <~s ,  Inc.,  Washington, 
D.C.  Part  1  is  of  particular  inte.ost  in  tne  March  1984  edition. 
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developed  from  the  first  half  actuals  to  the  budget  equation  for 
the  second  half  of  the  curve;  all  of  which  yields  the  new  S- 
shaped  curve  4  of  Figure  5.  In  addition,  this  procedure  allows 
the  development  of  a  forecast  for  the  end  cost  of  the  project 
which  is  constrained  by  the  planning  and  other  subjective  infor¬ 
mation  inherent  in  the  original  budget  curve. 


%  Total. 


(4)  At  this  point,  a  program  manager  may  take  several 
different  approaches.  First,  if  he  wants  to  learn  the  absolute 
figure  for  the  final  cost  of  the  project,  curve  4  may  be  modified- 
by  inclusion  of  inflation  data.  In  this  case,  the  forecast 
expenditure  data  of  curve  4  would  be  multiplied  by  an  inflation 
index  to  get  a  new  curve  which  is  labeled  5  in  Figure  5.  How¬ 
ever,  in  doing  this  he  should  have  in  mind  a  concept  of  the 
errors  inherent  in  any.  process  such  as  the  one  just  described. 

Up  to  this  point  we  have  not  mentioned,  for  the  sake  of  sim¬ 
plicity,  that  there  is  an  error  involved  in  forecasting  which 
should  be  expressed  as  a  confidence  interval  around  curve  4.  The 
confidence  band  indicates  that,  with  some  given  probability,  one 
may  expect  the  real  value  for  any  point  on  the  line  to  fall  some¬ 
where  within  this  particular  interval.  When  the  budget  curve  is 


compared  with  the  forecast  curve,  only  one  error,  the  standard 
error  of  the  forecast,  must  be  considered.  This  leads  to  the 
situation  shown  in  Figure  6. 
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Figure  6:  The  Error  of  the  Forecast 


Here  the  confidence  band  indicates  the  possible  range  of  values 
(from  b  to  c)  in  which  the  true  cost  of  the  program  is  expected 
to  fall,  and  similarly,  the  range  of  the  size  [from  (1)  to  c]  of 
the  potential  program  overrun. 

However,  if  one  desires  to  compare  the  full  cost,  with  infla-- 
tion,  of  the  project  (Curve  5,  Figure  5)  with  the  full  inflated 
cost  of  the  budget,  both  the  error  of  the  forecast  and  the  error 
involved  in  developing  the  inflation  figures  must  be  considered. 
This  has  the  effect  of  greatly  increasing  the  size  of  the  confi¬ 
dence  bands  as  is  shown  in  Figure  7.  The  end  result  is  that  the 
ability  to  compare  the’ final  cost  of  the  project  with  the  budget 
cost  is  greatly  impaired.  As  Figure  7  shows,  in  this  case  one 
could  anticipate  a  tremendous  overrun  or  an  underrun  [a  -  d]  from 
the  same  data. 
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Figure  7:  The  Error  of  the  Forecast  and 
The  Error  of  the  Inflation  Forecast 

The  lesson  here  is  to  compare  figures  in  a  manner  which  will 
minimize  the  errors  involved  in  the  comparison.  In  other  words, 
the  best  picture  of  the  status  of  a  project  may  be  gained  by  com¬ 
paring  the  two  curves  shown  in  Figure  6.  This  comparison  pro¬ 
vides  all  of  the  information  required  for  day-to-day  management 
of  the  program.  If  a  full  end  cost  of  the  program  is  desired, 


this  can  be  developed  quickly  by  simple  multiplication  utilizing 
whatever  inflation  forecast  is  deemed  appropriate  at  the  time 
that  the  information,  is  required. 


This  does  not  mean,  however,  that  the  program  manager  should 
not  use  the  actual  inflation  data  when  it  is  available.  In  this 
case,  no  errors  of  forecast  are  present  because  the  actuals  in 
both  program  cost  and  inflation  rates  are  known.  This  makes  it 
very  easy  to  remove  the  effects  of  inflation  to  see  how  much  of 
an  overrun  is  actually  attributable  to  other  causes. 

Figure  8  shows  a  case  in  which  the  deflated  budget  curve  1  is 
modified  by  the  actual  experienced  inflation  to  derive  curve  2. 
One  may  readily  compare  this  curve  with  the  contractor's  inflated 
actuals  (curve  3)  to  determine  the  actual  extent  of  the  overrun. 
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Figure  8:  The  Use  of  Actual  Inflation  Data 

Another  situation  #  which  this  method  of  program  monitoring 
will  easily  handle  is  *  the  case  of  the  schedule  slippage  or  pro¬ 
gram  extension.  Of  the  two,  the  slippage  is  the  most  severe 
because  it  often  occurs  early  in  the  project  where  it  has  a  pro¬ 
found  effect  on  costs.  Assume  once  again  the  basic  deflated 
budget  curve  shown  in  Figure  9  with  an  actual  deflated  expendi¬ 
ture  curve  as  shown. 


/.  rv  rn  i. 
£KP£»b  ITtSfiC^ 


Figure  9:  The  Program  Slippage  Situation 


It  would  appear  upon  initial  inspection  that  the  program  is-  .run¬ 
ning  slightly  below  the  planned  expenditures  at  time  t.  However, 
it  is  revealed  that  the  R&D  program  is  actually  behind  schedule, 
having  only  accomplished  the  number  of  milestones  associated  with 
time  t-1,  To  compensate  for  this  slippage,  move  curve  2  back  one 
unit  from  t  to  t-1  so  that  the  actual  expenditures  are  now  shown 
as  curve  3  in  their  proper  relationship  with  the  budget  curve. 
This  is  actually  accomplished  mathematically  by  calculating  a  new 
inflection  point  which  will  reflect  the  slippage  in  the  schedule.. 
This  new  point  is  derived  from  the  equation  for  curve  2  by  calcu¬ 
lating  the  inflection  point  not  at  time  T,  the  location  of  the 
original  point,  but  rather  at  time  T  +  1,  the  location  of  the 
inflection  point  after  slippage  has  occurred.  This  new  inflec¬ 
tion  point  becomes  the,  intercept  of  the  equation  for  the  top  half 
of  the  budget  curve,  and  the  time  values  which  are  used  to  fore¬ 
cast  from  the  top  half  of  the  budget  curve  now  start  at  the  T  +  1 
increment  (instead  of  T)  and  continue  to  the  100%  +  1  increment 
(instead  of  the  100%  increment)  . 
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The  Most  Likely  Cost, 

Forecasting  the  roost  likely  cost  proceeds  in  the  same  manner 
listed  in  the  previous  section  up  to  the  point  at  which  a  new 
Inflection  point  is  forecast.  The  actuals  are  converted  to  per¬ 
centages  and  plotted  in  the  same  wanner ,  and  the  curve  form  to 
plot  these  actuals  is  the  same  equation  type  selected  to  describe 
the  bottom  half  of  the  general  curve.  At  this  point,  however, 
the  method  of  forecasting  changes  considerably. 

Instead  of  merely  splicing  the  top  half  of  the  general  curve 
onto  the  new  bottom  curve,  the  bottom  curve  is  actually  mapped 
into  the  general  curve  framework.  This  is  accomplished  as  fol¬ 
lows; 


(1)  Using  the  deflated  actuals  from  the  program,  fit 
whatever  curve  form  is  used  in  the  bottom  half  of  the  general 
curve  to  these  data  and  forecast  a  new  value  for  cumulative 
expenditures  at  the  inflection  point..  This  new  value  is  found  by 
substituting  the  cumulative  percent  time  figure  which  corresponds 
to  the  general  curve  inflection  point  into  the  new  equation  which 
was  derived  from  the  actuals. 

(2)  Take  the  new  value  for  cumulative  expenditures  and 
let  this  value  be  equal  to  the  cumulative  percent  of  budget  fig¬ 
ure  which  is  associated  with  the  inflection  point  on  the  general 
curve. 


(3)  Using  the  relationships  established  in  1  and  2,  the 
top  half  of  the  general  curve  may  now  be  converted  from  cumula¬ 
tive  percentage  figures  to  forecast  cumulative  expenditures  for 
the  program  being  investigated. 

This  forecasting  method  has  several  advantages; 

{1}  The  time  over  which  the  program  is  planned  to  run  is 
taken  as  a  given  unless  evidence  to  the  contrary  is  discovered. 

(2)  The  lower  curve  forecast  is  mapped  into  the  general 
curve  format,  thereby,  creating  a  smooth  S-shaped  curve  for  the 
entire  program.  Simply  splicing  the  curves  as  is  done  with  the 
budget  curve  in  the  previous  section  will  often  create  discon¬ 
tinuities  in  the  curve. 

(3)  The  forecast  which  is  created  in  this  method  is 
based  strictly  on  the  assumption  that  expenditures  in  this  par¬ 
ticular  program  are  proceeding  in  the  same  manner  that  all  past 
programs  have  proceeded. 
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The  Worst  Possible  Coal, 


Developing  the  forecast  for  the  worst  possible  cost  is  only  a 
matter  of  slightly  modifying  the  previous  most  likely  cost  fore¬ 
cast,  A  confidence  interval  for  the  most  likely  cost  is  calcu¬ 
lated  by  standard  statistical  methods.  The  upper  limit  of  this 
confidence  band,  based  on  whatever  level  of  confidence  was 
selected  by  the  analyst,  will  give  the  cost  figure  that  one  can 
be  Xfc  certain  will  not  be  exceeded.  Coupled  with  the  most  likely 
cost,  this  is  an  excellent  management  tool. 

In  summary,  one  may  develop  three  possible  forecasts  from  the 
S-shaped  curve.  The  "spliced"  curve  forecast  using  the  program 
budget  curve  reflects  an  expenditure  of  the  lowest  possible  mag¬ 
nitude.  For  this  expenditure  to  be  realized,  the  program  must 
run  exactly  as  planned  from  the  inflection  point  onward.  This  is 
a  highly  unlikely  situation  if  any  increased  expenditures  have 
been  incurred  early  in  the  program.  The  most  likely  cost  and  its 
confidence  band  which  extends  to  th^  upper  confidence  limit  (or 
the  worst  possible  cost)  for  the  program  are  clearly  the  most 
realistic  forecasts.  This  is  because  the  method  of  mapping  the 
new  forecast  for  the  bottom  of  the  curve  into  the  general  curve 
format  places  the  entire  program  in  a  more  legitimate,  historical 
perspective.  ■  ' 
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A  BENEFIT-COS?  MODEL 


III  = 


Benefit-cost  models  provide  an  approach  to  solving  problems 
of  choice.  In  this  case,  the  objective  might  be  to  choose  the 
EMP  protection  design  that  provides  the  highest  ratio  of  protec¬ 
tion  achieved  per  dollar  spent.  Other  criteria  besides  a 
benefit-cost  ratio  might  also  be  appropriate.  For  example,  cri¬ 
teria  such  as  the  magnitude  of  first-year  costs,  budget  limita¬ 
tions,  uncertainty  about  future  inflation  or  discount  rates,  and 
the  degree  of  flexibility  inherent  in  a  particular  design  might 
be  important  for  a  particular  program.  A  good  benefit-cost  model 
should  permit  the  program  manager  to  consider  a  broad  range  of 
decision  criteria. 

Benefits  are  often  measured  in  dollars.  In  the  case  of  EMP 
protection  however,  a  dollar  value  cannot  be  placed  upon  the 
amount  of  protection  achieved  from  a  particular  design.  We 
therefore  must  resort  to  some;  non-monetary ,  generic  measure  of 
the  amount  of  EMP  protection  .achieved.  As  I  indicated  earlier, 
the  legitimate  application  of  a  benefit-cost  model  is  crucially 
dependent  upon  the  availability  of  such  a  measur  •  . 

Keep  in  mind  t  len,  that  for  a  particular  EMP  protection 
design,  all  dollar  amounts  are  costs.  Benefit-cost  ratios  are 
achieved  by  placing  the  measure  of  the  amount  of  protection 
achieved  in  the  numerator  and  the  present  value  of  life  cycle 
costs  in  the  denominator. 

Before  I  address  out  particular  model,  it  is  worthwhile  to 
discuss  some  basic  concepts,  beginning  with  a  brief  review  of  the 
time  value  of  money.  I  then  discuss  the  standard  present  value 
cost  equation,  discount  rates,  economic  life,  and  adjustments  for 
uncertainty  with  regard  to  future  expenditures. 

Let's  begin  with  the  time  value  of  money.  A  dollar  paid' 
today  is  not  worth  a  dollar  tomorrow  because  there  is  an  c  '■por- 
tunity  cost  that  is  determined  by  the  amount  of  interest  a  c  liar 
could  have  earned  in  an  alternative  investment.  For  example,  a 
government  tax  dollar  today  is  not  worth  a  dollar  tomorrow;  it  is 
worth  more  because  it  could  be  invested  in  the  private  sector  and 
then  be  reclaimed  with  interest  when  tomorrow  arrives.  Also, 
tomorrow's  dollar  is  not  worth  a  dollar  today.  After  all,  the 
government  could  deposit  90  cents  in  a  10  percent  investment  and 
receive  about  one  dollar  one  year  from  now.  Many  decision  prob¬ 
lems  deal  with  situations  in  which  amounts  of  money  that  exist  in 
different  time  periods  must  be  compared.  This  is  the  essence  cf 
the  time  value  of  money  problem. 
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Consider  the  following  tools  for  time  value  of  money  calcula¬ 
tions  . 

( 1)  Future  value,  single  amount: 

Sn  “  So<1  +  c>n 

wher e  t 

Sn  =  Future  value  at  the  end  of  the  nth  period 
■  Q  *  Present  value  at  time  zero 

r  «  Interest  (discount)  rate  expressed  as  a  decimal 
n  -  Number  of  periods 

(2)  Present  value,  single  amount; 

Sn 

S  *x  — .  . . . 

°  U  +  r)n 

where  the  definitions  expressed  above  remain  true. 

£3)  Present  value,  multiple  cash  amounts  over  time; 

(a)  Time  line: 
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(b)  The  present 

value  of 

these 

cash  amounts, 

•  »  Sn-1,  Sn '  can 

be  expressed 

as: 

n 

2 

i=0 

si 

(3) 

(1  +  r)1 

(c)  Equation  (3)  converts  the  cash  amounts  over  time 
as  expressed  on  the  time  line  in  paragraph  3  above  to: 

n  S, 

2  - = - r 

"  i-0  (1  +  r ) 1 

0  1  2  3  Z  5  ^  u-2  iT— I  ~ 
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(4)  It  alternate  LCCiS  protection  designs  arc  to  be  com¬ 
pared,  the  cash  amounts  per  time  period  for  each  alternative  must 
be  converted  to  sums  which  occur  at  a  single  point.  For  example: 


Alu-nut  lve 
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(b)  The  costs  which  occur  over  the  life  cycle  of 
Alternative  A  can  be  converted  to  a  present  value  cost  by  using 
equation  (3)  above.  A  similar  calculation  would  be  accomplished 
for  Alternative  0 .  The  results  would  be  as  depicted  on  the  time 
lines  shown  below. 
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(5)  Benefit-cost  ratios  for  each  alternative  can  now  be 
calculated  using  the  measure  of  the  degree  of  protection  achieved 
that  I  discussed  earlier  and  the  present  value  cost  for  the 
alternative  in  question.  For  example: 

Benefit-Cost  Rati  -  present  valu>":  cost  for  Al te mat ive  A 
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(6)  Let's  consider  Uniform  Annual  Amounts  (sometimes 
referred  to  as  Annuities)  over  a  period  of  n  years.  A  shorthand 
version  of  the  present  value  cost  equation  can  be  used  to  sim¬ 
plify  the  analysis. 

(a)  Consider  our  present  value  equation  with  all  of 
the  equal  to  amount  A; 

n  » 

P.V.  -  (present  value)  -  2  - - — r  (4) 

i-1  (1  +r ) 1 


write : 


(b)  Since  A  is  independent  of  period  i,  we  can 


P.V.  -  A  i  - ± - r 

i“l  (1  +  r ) 1 

(c)  Which  can  be  shown  to  be  equal  to: 


P.V.  -  A 


[1  +r)n  -  1 


r  (1  +  r)1 


As  a  final  note,  it  is  sometimes  useful  to  abbreviate  as -fol¬ 
lows  : 


pvf  *  present  value  factor 


pvaf  «  present  value  of  an  annuity  factor 


(1  +  r)n 

or  -  U-+  r)n  -  I 

r (1  +  r )  n 


Now  consider  the  interest  (discount)  rate  used  in  government 
present  value  calculations.  The  choice  of  a  discount  rate  is 
based  on  the  premise  that  no  government  investment  should  be 

undertaken  without  explicitly  considering  the  alternative  use  of 
the  funds  which  it  absorbs  or  displaces. 

One  way  for  the  government  to  assure  this  is  to  adopt  a 
discount  rate  policy  which  reflects  private  sector  investment 
opportunities  foregone.  The  discount  rate  reflects  the  prefer¬ 
ence  for  current  and  future  money  sacrifices  that  the  public 
exhibits  in  non-government  transactions.  A  10  percent  rate  is 
considered  to  be  the  most  representative  overall  rate  at  the 
present  time.  The  government  prescribed  discount  rate  of  10  per¬ 
cent  represents  an  estimate  of  the  average  rate  of  return  on 
private  investment  before  corporate  taxes  and  after  adjusting  for 


inflation.  The  cost  analysis  may  include  a  test  at  other 
discount  rates. 

The  economic  lives  of  alternative  EMP  protection  designs 
govern  the  time  period  to  be  covered  by  a  program  evaluation. 
Normally,  these  lives  will  approximate  the  life  of  the  facility 
protected.  The  economic  lives  for  the  alternatives  should  be 
set,  whenever  possible,  so  that  the  alternatives  yield  benefits 
(EMP  protection)  for  the  same  period  of  time.  If  this  is  not 
possible,  the  time  period  of  the  analysis  should  be  based  on  the 
life  of  the  asset  with  the  shorter  time  period.  In  this  case, 
the  residual  value  of  the  asset  with  the  longer  economic  life 
must  be  considered  in  computing  the  costs  of  that  alternative. 

Estimates  for  inflation  in  future  years  are  often  important 
in  program  evaluations.  To  detect  the  effect  of  changes  in  the 
purchasing  power  of  the  dollar,  the  program  manager  should  con¬ 
sider  both  constant  dollars  (without  inflation)  and  current  dol¬ 
lars  (with  inflation)  in  analyzing  and  evaluating  alternatives. 
To  assure  consistency,  the  first  estimate  of  costs  for  each  year 
of  the  planning  period  should  be  made  in  terms  of  constant  dol¬ 
lars  (that  is,  in  terms  of  the  general  purchasing  power  of  the 
dollar  at  the  time  of  decision)  .  If  inflation  is  an  important 
factor  for  the  future,  a  second  computation  should  be  made  in 
terms  of  current  (inflated)  dollars.  When  there  is  reason  to 
believe  that  price  levels  will  significantly  affect  the  choice 
between  alternatives,  the  indices  cited  earlier  should  be  Used. 
When  including  inflation  for  a  cost  which  occurs  more  than  4 
years  beyond  the  present  year,  be  aware  of  the  uncertainty  in 
making  a  valid  economic  forecast,  and  the  fact  that  imputed 
values  for  inflation  may  change  considerably. 

To  determine  the  change  in  real  price  (exclusive  of  the 
effect  of  discounting),  calculate  the  effect  of  inflation  in 
three  distinct  steps,  as  follows: 

(1)  Determine  the  constant  dollar  annual  cc  of  the 
alternative. 

(2)  Inflate  the  annual  cost  using  appropriate  indices. 

(3)  Apply  the  discount  rate  to  the  escalated  (current 
dollar)  amount. 


The  present  value  equation  presented  earlier  can  also  be 
adjusted  for  uncertainty  with  regard  to  the  actual  amounts  of 
future  costs.  By  substituting  certainty  equivalents  for  expected 
future  costs,  the  model  permits  a  decision  maker  to  make  an 
explicit  tradeoff  between  the  expected  value  of  each  cash  amount 
and  its  associated  uncertainty,  or  risk. 

The  essential  characteristics  of  the  risk  adjusted  present 
value  equation  are  as  follows: 


* 


i=0  (1  +  r) 1 


where:  PV  =  The  present  value  at  time  zero  of  a  series  of  risk- 

adjusted  cash  amounts  which  occur  in  the  future  for 
a  particular  program. 
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r  =  An  appropriate  risk-free  discount  rate. 

* 

=  The  risk-adjusted  expected  value  of  the  cash  amount 
for  period  i,  i  *  0,  1,  2,  .  .  .  n.  This  amount  is 
commonly  called  a  certainty  equivalent. 

* 

For  period  i,  a  certainty  equivalent  (S ^ )  can  be  obtained  by 
having  the  decision  maker  specify  the  amount  of  money  that  would 
make  him  indifferent  between  this  certain  amount  and  the  expected 


3 

I  use  the  terms  "risk"  and  "uncertainty"  interchangeably. 
For  either  term,  I  assume  that  future  cash  amounts  have  associat¬ 
ed  probability  distributions.  Risk  (uncertainty)  can  be  measured 
in  terms  of  the  degree  of  dispersion  about  the  mean  of  the  proba¬ 
bility  distribution.  Also  note  that  the  probability  distribu¬ 
tions  associated  with  future  cash  amounts  are  determined  by  the 
uncertainties  inherent  in  the  development,  production,  operation, 
and  maintenance  of  a  particular  EMP  protection  design.  As  dis¬ 
cussed  earlier,  factors  for  inflation  due  to  changing  resource 
costs  can  also  be  included.  However,  larger  risks,  such  as  the 
risk  associated  with  the  stability  of  the  monetary  system,  are 
exogenous  to  the  model. 

4 

In  some  versions  of  the  model,  the  discount  rate  is  adjust¬ 
ed  to  include  a  risk  premium  for  each  period.  This  adjustment  is 
used  in  lieu  of  the  certainty  equivalent  adjustments  to  the  ex¬ 
pected  cash  amounts.  Again,  the  degree  of  risk  is  determined 
solely  by  uncertainties  inherent  in  the  development  and  produc¬ 
tion  of  that  particular  weapon  system. 
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cash  amount  with  its  associated  risk.  The  magnitude  of  this  cer¬ 
tainty  equivalent  is  determined  by  the  decision  maker's  attitude 
toward  the  risk.  There  are  undoubtedly  some  decision  makers  who 
would  prefer  risk  and  some  who  may  be  indifferent  to  risk,  but 
conventional  opinion  among  economists  holds  that  the  majority  of 
decision  makers  involved  with  large  sums  of  money  tend  to  be 
risk-averse . 

Thus,  each  S*  is  calculated  by  multiplying  the  expected  cash 
amount  for  period  i  by  a  certainty  equivalent  factor  which  is 
based  upon  the  decision  maker's  attitude  toward  risk.  The  cer¬ 
tainty  equivalent  factor  for  a  cost  must  be  a  number  greater  than 
one,  i.e.,  the  present  value  cost  is  made  larger. 


IV.  SUMMARY  AMD  RECOMMENDATIONS 


The  LCCE  will  generate  valuable  cost  data  which  can  be  used 
to  develop  planning  models  for  future  EMP  protection  retrofit 
programs.  In  this  paper,  I  have  briefly  discussed  the  status  of 
the  LCCE  cost  model,  presented  an  S-curve  model  for  R&D  cost 
forecasting,  and  finally,  discussed  a  possible  benefit-cost  model 
for  comparing  alternative  EMP  protection  designs.  The  S-curve 
model  can  be  developed  from  the  LCCE  data  base  with  no  limiting 
requirements.  The  benefit-cost  model  cannot  be  developed  unless 
it  includes  some  generic  measure  of  the  degree  of  protection 
achieved  by  the  alternate  EMP  protection  designs  (custom  shield¬ 
ing  and  tailored  protection) . 


I  recommend  that  we 
LCCE  cost  data  base, 
model  appear  to  be 
planners.  Other  models 
tion  focused  on  defense 
tures  envisioned  for  a 
appear  worthwhile  to 
appropriate  models  for 
casts . 


continue  to  explore  possible  uses  for  the 
The  S  -curve  .model  and  the  benefit-cost 
useful  tools  for  future  EMP-protection 
are  possible.  Given  the  amount  of  atten- 
budgets  and  the  relatively  large  expendi- 
large-scale  EMP  retrofit  effort,  it  would 
provide  EMP  protection  planners  '  with 
conscientious  and  accurate  budget  fore- 
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